Scalable Data Correlation
نویسنده
چکیده
The fast capacity growth of cheap storage presents an ever-escalating problem for forensic investigations as currently employed forensic technologies are not designed to scale to the degree necessary to meet the challenge. In this work, we present an approach which seeks to scale up the process of finding related digital artifacts across large data sets by employing an advanced version of our similarity digest tool sdhash. Specifically, we demonstrate that the digest generation process can be performed at rates exceeding those of crypto hashes on commodity multi-core systems. Digest comparison rates allow us to query the digest of a 1TB target for the (trace) presence of a small file in less than one second with very high precision and recall rates.
منابع مشابه
Subband Adaptive Motion Compensated Temporal Filtering for Scalable Video Coding
This paper proposes a subband adaptive motion compensated temporal filtering (MCTF) technique for scalable video coding. In scalable video coding schemes, hierarchical MCTF is widely adopted to exploit the temporal correlation across frames, for its good performance in energy compaction and its ability in providing efficient SNR scalability. In this hierarchical MCTF structure, the temporal cor...
متن کاملAnatomy of a Secure and Scalable Multiagent System for Event Capture and Correlation
Event monitoring and correlation across a large network is inherently difficult given limitations in processing with regards to the huge quantity of generated data. Multiple agent systems allow local processing of events, with certain events or aggregate statistics being reported to centralized data stores for further processing and correlation by other agents. This paper presents a framework f...
متن کاملDynamic configuration and collaborative scheduling in supply chains based on scalable multi-agent architecture
Due to diversified and frequently changing demands from customers, technological advances and global competition, manufacturers rely on collaboration with their business partners to share costs, risks and expertise. How to take advantage of advancement of technologies to effectively support operations and create competitive advantage is critical for manufacturers to survive. To respond to these...
متن کاملA Tandem Scalable Microwave-Assisted Williamson Alkyl Aryl Ether Synthesis under Mild Conditions
An efficient tandem synthesis of alkyl aryl ethers, including valuable building blocks of dialdehyde and dinitro groups under microwave irradiation and solvent free conditions on potassium carbonate as a mild solid base has been developed. A series of alkyl aryl ethers were obtained from alcohols in excellent yields by following the Williamson ether synthesis protocol under practical mild condi...
متن کاملUsing Mapreduce to Scale Events Correlation Discovery for Business Processes Mining
Using Mapreduce to scale events correlation discovery for business processes mining Hicham Reguieg, Farouk Toumani, Hamid Reza Motahari Nezhad, Boualem Benatallah HP Laboratories HPL-2012-170 business processes; Event Correlation; map reduce The volume of data related to business process execution is increasing significantly in the enterprise. Many of data sources include events related to th...
متن کاملA Framework for Adaptive Scalable Video Coding Using Wyner-Ziv Techniques
This paper proposes a practical video coding framework based on distributed source coding principles, with the goal to achieve efficient and low-complexity scalable coding. Starting from a standard predictive coder as base layer (such as MPEG-4 baseline video coder in our implementation), the proposed Wyner-Ziv scalable (WZS) coder can achieve higher coding efficiency, by selectively exploiting...
متن کامل